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ABSTRACT 

Tie development and documentation of procedures to 
conduct a coeprehensive follovup survey in addition to the 
coBpilation of the perceptions of recent graduates regarding the 
quality of their preparation for teaching vere the goals of this 
Investigation. The saiple consisted of 196 1973-7* graduates of 
teacher preparation prograas under the aegis of the College of 
Education at a land Grant Oniversity accredited by the Southern 
Association of Colleges and Oniversities and the Rational Council for 
Accreditation of Teacher Education. The instruaent designed for this 
investigation contained thirty iteas vith tvo response scales 
(iaportance and effectiveness) associated vith each itea. In 
addition^ deaogcaphlc iteas and four open-ended questions vere 
included on the instrument in such fashion to permit the respondent 
to fold a single sheet, affix the edges, and remit by mail. Tvo 
mailouts and a telephone contact resulted in a total return of 62.8 
percent of the graduates surveyed. Procedures determined to 
facilitate a foll6v*up study of this nature Include (1) a systematic 
plan for compiling addresses of graduates^ (2) the utilization of a 
durable single sheet mailout instrument^ and (3) telephoning 
non^ respondents. The perceptional ratings obtained on the value of 
the instructional units and the quality of instruction experienced 
have provided meaningful information to program developers for 
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In recent years, education has experienced numerous alterations in 
the methods espoused in teacher preparation programs because of increased 
attention to individualized instruction and coii5)etency baiied teaclier educa- 
tion* lliese changes have in part, been influenced hy the emphasis placed on 
teacher accountability in public sdiools* Improving the quality of teaching 
and teachers rest primarily with the college designed instructional programs 
and personnel who have been vested with the responsibility of producing com- 
petent and effective teachers* ' An outgrowth of the en^hasis on accountable 
teadiing, has been tlie development of techniques which attempt to assess the 
skills and capabilities of tlie teacher* Research in teacher education has 
increased dramatically, but to date no single method has been determined to 
be the most effective teclinique to foster learning (Sandefer, § Bressler, 1972)* 
Tliis research has demonstrated, however, that assessment of the teacher is 
the mst direct measure of tlie educational program*s outcome; since the 
teaclier is a manifestation of the goals and objectives established for the 
prograjn* Tlierefore, results obtained frcm evaluations of teachers (self- 
reports and supervisor reports) should be included in programmatic decisions 
related to tlie training tliey experienced in becoming certified* Such in- 
formation may be gained through a follow-up study of recent graduates* Im- 
plementing this strategy after a semester of teaching provides the recent 
graduate an opportunity to apply the skills and content stressed in their 
prescnrice preparation* /iith "real world** experience, the graduate is in a 
more tenable position to critically assess the value of the program objec- 
tives and tlie effectiveness of his recent pedagogical preparation* 

This feedback provides program staff with qualitative ratings of the 
program, actual classroom needs of the teacher, and insights of skills 
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required in the classroom wliich may not have been stressed by the exist- 
ing courscwork* Corresponding information can be requested from the 
inmediate siq)ervisor of the graduate based on his perfoimance* Numerous 
educational programs have been evaluated with follow-up studies, e*g*, status 
of high scliool graduates (Welch, Lindbloom and Flahaven, 1971), graduates 
of a secretarial scliool C6ell,§ Bleil, 1973), location of comnuiiity college 
graduates (Behrendt, 1974) , and graduates of a nursing program (Padillo, 1974)* 
Tlie utility of tiie follow-up survey has also been exeiiq>lified with eval- 
uations of teaclier education graduates (Hopkins, 1970; Aiams, 1974)* 

McKinney and Qglesby (1971) have defined a follow-up study as "a pro- 
cedure for accumulating pertinent data from or about individuals after tliey 
have had sijnilar or coniparable experiences/* Follow-up studies customarily 
are conducted utilizing one of three formats* One of these approaches, the 
personal interview, is used to gatlier information vis-a-vis* This technique 
usually provides very accurate information, however, it is tijne consuming, 
expensive, and in most cases reduces tlie number of individuals who can be 
surveyed* A second method is the telephone interview* Disadvantages of 
this approacli may outweigli the advantages because of the substantial time 
investnient necessary to locate and actually contact individuals by phone* 
Certainly an advantage of the telephone is direct cOTmunication and the 
opportunity to clarify any misunderstandings concerning the questions raised 
by tlie interviewer* The most conventional approach of conducting a follow- 
up study involves the use of a mailout opinionaire* Paper and pencil instru- 
jHents allow for tlie canvassing of a mucli larger sample at a fraction of the 
cost in dollars and hours, but this approach often suffers from misinterpre- 
tation of items by sui^jects and a low response ratio* 
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Purpose 

A common limitation encountered in reviewing follow-iq) investigations 
is tlie lack of attentibn addressed to methodological tecliniques* Often, 
reports contain only results of a survey with no description of how the data 
were collected* Procedural documentation is critical if follow-up investi- 
gations are to provide significant data for program evaluation* For this 
reason, tlic goals of tliis investigation included the development and documen- 
tation of procedures to conduct a coTiqprehensive follow-up survey as v/ell as 
compilation of observations of recent graduates concerning the quality of 
tlieir preparation* 

Method 

Subj ects 

The sample consisted of 1973-74 graduates of teacher preparation pro- 
grams under the aegis of the College of Education at a Land Grant University 
accredited by the Southern Association of Colleges and Universities and the 
National Council for Accreditation of Teadier Education* For the purpose of 
this investigation, all graduates from the elementary area and secondary area 
were combined to form a total of 212 individuals of whom 685 were female* 
Six montlis after spring graduation, (1974), more than 90?f of the graduates 
resided witliin tlie state where the degree was conferred* 
Instrumentation 

"Hie follow-up instrunent used in this investigation contained two 
Likert-type scales referenced to a single ston* Thirty plvrases or terms 
(table 2) related logically to instructional units in the preparatory pro- 
grams constituted a substantial portion of the instrument* Information was 
sought on the worth of different instructional con5)onents on one scale (iii^ror 
tance scale) and a rating of the quality of instruction providcid for tliat 



ERIC 



5 



One Approach to; page 4 

unit on the second scale (effectiveness scale)* In addition, demographic 
items about the graduate*s current position and future plans were posed, as 
well as four open ended questions tliat peiudtted discussion of issues not 
specified in ti\e thirty items* This infoxtnation was organized on a single 
sheet to encourage individuals to respond* Hie instrument contained the 
return address ajid prepaid postage label; individuals completing the ques- 
tionnaire merely folded tlie instrument and stapled or taped the ends and 
remitted it by mail* 

A parallel questionnaire was developed to obtain responses from the 
siq)ervisor, i,e*, principal or d^artment head, of the teaching graduate* 

\ 

Tliis corresponding information from supervisors was sought to provide po- 
tential criterion variables for regression models used to determine empir- 
ically the quality of the instructional con^onents* 

Interesting reliability and validity questions arise with two scaled 
instruments of tliis nature* For example, a legitimate question is whetlier 
a mental set for that item occurs ajid a similar rating results on both 
scales* To ansv/er this question a series of comparisons were made* It was 
determined tliat fourteen of 30 correlated t-tests conducted with data ob- 
tained from the 1973-74 graduates on ratings of effectiveness and iji5)ortance 
were statistically different at the *01 level* lliese results suggest that 
response set is not a measurement concern for these tv/o scaled items* 

The reliability of the instruoment was confirmed by comparing importance 
scale respojiscs between first year graduates of 1972-73 and 1973-74* Tliese 
comparisons were tliought to be feasible since the instructional program com- 
ponents and staff remained virtually unchanged* Comparisons of uncorrelated 
san5)les were conducted to determine the stability of the instrument with 
different groups over time* Not one of the thirty comparisons were signif- 
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icantly different* Alditional con^arisons were made between these groups 
with respect to the effectiveness scales* One t^test in 30 con^Kirisons was 
different, statistically* Because S9 of 60 comparisons were determined to 
be statistically ecjuivalent, it appears safe to state tliat both scales 

produce stable responses over time* Face validity of tlie instrument was 
obtained by submitting the original versions of the instrument to a panel of 
ten judges* Hie resulting scales and items on the instrument were agreed on 
after refilling three drafts* 
Procedure 

ftembers of the sample were identified from the rosters of tlie student 
teaching course* The most recent addresses of tlie individuals were then 
obtained by one of four methods* First, names and permanent addresses of 
graduating seniors were obtained from certification applications submitted 
at the conclusion of all coursework* Addresses obtained in this manner were 
usually accurate since receipt of certificates from the state department of 
education usually required three months; therefore, temporary university 
addresses were not supplied on the applications* Tliis technique provided 
addresses on nearly 8S? of the total sample* 

A contingency plan was en^loyed wliere certification seeking graduates 
were provided a postcard (figure 1) and requested to remit it once tlieir 
employment plans were established* Thirty percent of the graduates returned 
completed cards from the total sample* 



Insert Figure 1 ^ 

ITie task of obtaining an accurate address on those graduates electing 
not to complete certification papers was more difficult* University records 
maintained by tlie alumni office were consulted and a permanent address. 
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often that of the parents ^ was obtained* If tliis search failed to produce 
an address J a final survey was made hy referring to the university phone 
directories for the preceding and current acadanic years* Addresses were 
obtained by one of these methods on 196 of the 212 graduates^ i*e*j 92*4%* 

A solicitation prepared to accompany each questionnaire provided a 
rationale for the follow-i^ study and requested assistance from each grad- 
uate* The cover letter and questionnaire were mailed to 196 graduates in 
early December^ 1974^ with six weeks allotted for return of the coiripleted 
instrument* After this period had elapsed a second mailout was conducted* 
If the second mailout failed to elicit a response ^ plione numbers of the 
reticent graduates were obtained from phone company directory assistance or 
postcards (figure 1)^ alumni records^ and university directories* Phone 
numbers gleaned from these sources often were those of the graduates* parents* 
For tliose subjects whose phone numbers were determined^ contact was attempted 
during tliree weeknights from 7:00 p*m* to 10:00 p*m* Individuals phoned were 
reminded to send in t]ie questionnaire or requested to provide a current addres 
for a third mailout* 

A parallel questionnaire was sent to the inmediate si^rvisor of all 
respondents wlio were teacliing* Responses v/ere recorded and processed for 
analysis on receipt of completed instrunients from the supervisor* 

After tl\e response period allotted for t]ie second mailout had transpired^ 
responses were compiled and displayed on a copy of the instrument and shared 
witli tliose who had participated in t]ie investigation* A brief explanation of 
the data^ how the data wore being used^ and a statement of gratitude for their 
interest ajid commitnient to the program were included with the data siminary* 
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Results 

Procedural Findings 

Mailouts to 196 graduates constituted the initial survey sainple in this 
investigation* Tlie yield from the first mailout was 60 responses or 30*6% of 
the graduates surveyed* Tlie second mailing contained 136 questionnaires of 
which S2 C26*S%) were dutifully con^leted and returned* 

' Phone listings were sought on tlie 84 graduates who failed to respond 
to either request* Current listings of 38 individuals (19*45) were gleaned 
from tlie records various directories used* Procurement of a more com- 
plete list of plione numbers was hampered by insufficient addresses and sur- 
name dianges* Thirty-four of these graduates were contacted by phone and 
agreed to remit tlie questionnaire^ one person refused to complete the ques- 
tionnaire, and contact was not made witli three others despite the fact their 
phone listing was kncwvn* Altliough verbal canmitments were obtained from 34 
individuals, only 11 additional instruments were returned* A total of 123 
questionnaires^ 62*8% of the graduates surveyed, was ultiinately received as 
a result of this investigation* Table 1 provides a sunmary of the ideogra- 
phic characteristics of the respondents* 



Insert Table 1 



Tlie proportion of males and females responding to the instrument cor^ 
responds closely to the sex distribution of tlie total sample, i*e*, 62 males, 
134 females* It is interesting to note that over one half of the male grad- 
uates and 2S% of tlie female graduates in this survey were employed in occupa- 
tional fields otlier than education* Parallel questionnaires were mailed to 
supervisors of the 61 graduates who were teaching* Of these, 38 remitted 
completed instruments for a cumulative percentage of 62*4%» 

9 
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* * 
InstruiTient I'liidings 

Utilizing the data collected in this investigation a number of statis- 
tical comparisons were rendered to determine the independence of the two scales 
and instrument stability* Tlie results of these tests ^ briefly noted earlier, 
indicate tlie scales arc botli stable and independent* Table 2 provides a 
summary of respojises expressed as percentages from the graduates regarding 
tlie quality (effectiveness) and value (inqportance) of tliirty instructional 
components in tlie secondary program* The collected data were tabulated sep- 
arately witli respect to tlie elementary and secondary program divisions be- 
cause the respective instructional components v/ere quit^ different* 



Insert Table 2 



Perceptions of first year graduates summarized in Table 2 indicate some 
discrepancies exist between what is being presented and what should be stress- 
ed to prepare candidates for the classroom* An example of a discrepancy in- 
volves tlie ratings on tlie unit, classroom control techniques, where recent 
graduates rated the need for instruction on this topic to be greats but 
perceived the effectiveness of the current instructional program to be wanting* 

Conclusions 

A significant reason for undertaking this investigation was to collect 
reactions and reflections of first year graduates, especially those gainfully 
employed as classroom teachers, on the nature of the teacher preparation pro- 
gram they had recently c<Mnpleted* Data of this nature were collected as 
noted by the sunmaries in Table 2, Tliis information combined with percep- 
tional ratings of siq>ervisors on parallel instruments have enabled the 

10 
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instructional staff to render decisiojis on replacing and revising various 

instructional cosnponents of tlie preparatory programs* In addition^ data from 

tliese sources have been combined with con^atible information collected during 

tlie instructional program by regression techniques to form algebraic equations 

for curriculum decisionmaking based on longitudinal data* 

A second reason for undertaking tliis investigation was to develop an 

efficient procedure for conducting follow-up studies* THo procedure establish 

ed, efficiency not witlistanding^ required a temporal span of four months to 

complete and yielded functional responses from approximately 60% of the sample* 

A suimary of the procedures includes; 

1* Compiling an address list utilising certification files, self- 
addressed postcards, alttnni records and telephone directories* 

2* Developing a durable mailout instrument on a single sheet which 
can be folded, sealed^ and mailed directly* 

3* Scheduling two mailouts approximately 4-6 weeks apart* 

i 

4* Tolcplioning non- respondents if total returns are less than 60% 
of the sample* 

S* Providing sunmaries o£ results to participants of the follow-up 
survey* 

In conclusion, the need for follow-up studies in teaclier preparation 
programs is increasing due to a press for accountable teachers and teaching* 
If program-related information is obtained through follow-up techniques and 
used to monitor program quality^ questions on tlie value of preservice programs 
for teacliers can be addressed directly with this information* 
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i'RlNCJPAL'S OR EMPLOYER'S NAME. 

SCHOOL OR BUSINESS PHONE 

TEACHING OR JOB ASSIGNMENT — 



Figure 1 

Request Form for decent Graduates 
to Remit on Gaining Employment 
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Table I 



Biographic Information of Participating 
1973-74 Graduates 



Frequency 



Qiaracteris tic * ffale Femle 



Respondents .40 83 

Occupational Status 

Teaching-Blem* Scliool 3 ^26 

Teaching Middle School 4 19 

Teaching-High School 8 1 

Teaching-Post Sec* 1 2 

Seeking Adv* Degree 9 8 

Housewife - 13 

Unemployed - 4 
liiiil>loycd in Field 

Otlier than Education 16 12 

Future liducational Plans 

Intend to seek 
advanced degree 

YES ' 21 41 

NO 11 11 

MAYBE 7 29 
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